Towards an Intuitive Sign Language Animation Authoring Environment For the Deaf
نویسندگان
چکیده
We are aiming at developing an online collaborative framework allowing Deaf individuals to author intelligible signs using a dedicated authoring interface controlling the animation of a 3D avatar. In this paper, we present the results that we have achieved so far. They mainly focus on the design of a User Interface assisted by novel input devices. In particular, we show, in two user studies, how the Leap Motion and Kinect-like devices can be used together for capturing respectively hand trajectories (position and orientation) and facial animation. We also show how these devices are integrated into a prototype that we will demonstrate during the workshop.
منابع مشابه
A SignWriting-Based Approach to Sign Language Processing
The SignWriting system is a practical writing system for deaf sign languages, composed of a set of intuitive graphical-schematic symbols and simple rules for combining them to represent signs. The SignWriting Markup Language (SWML) is an XML-based language for encoding sign language texts, written in SignWriting, in an application and computer platform independent way. Thus, sign language texts...
متن کاملMultimedia courses generator for deaf children
In this paper, we present an environment developed in the Research Laboratory of Technologies of Information and Communication [13] of the University of Tunis to aid deaf people in improving their social integration and communication capabilities. In fact, it is proved that sign language is not innate at deaf children and therefore it needs methodic and specific training. In this context, our e...
متن کاملA dynamic environment for Greek Sign Language Synthesis using virtual characters
In this paper, we present a system that performs sign language synthesis in the framework of an educational platform for young deaf children. The proposed architecture is based on standardized virtual character animation concepts for the synthesis of sign sequences and lexicon-grammatical processing of Greek sign language (GSL) sequences. A major advantage of the proposed architecture is that i...
متن کاملTwo gesture recognition systems for immersive math education of the deaf
The general goal of our research is the creation of a natural and intuitive interface for navigation, interaction, and input/recognition of American Sign Language (ASL) math signs in immersive Virtual Environments (VE) for the Deaf. The specific objective of this work is the development of two new gesture recognition systems for SMILETM, an immersive learning game that employs a fantasy 3D virt...
متن کاملBilingual Education and Necessity to Differentiate Two Educational Challenges for Deaf Students
Background: Some obstacles and inefficiencies in deaf education system may be attributed to the fact that the right to education and equality of opportunities for national core curriculum, and the need for learning Farsi language are not met separately among deaf students. In fact, the distinction between these two educational challenges is not addressed to deaf pupils in particular. Based on t...
متن کامل